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PREFACE 


This report on the construction and standardisation of an 
Achievement Test in Hindi is being published according to our- 
policy of providing the maximum possible information about 
the test to its users. In the case of an achievement test such 
a report is not merely useful but almost indispensable as the 
content validity eould be assessed only if one has information 
on the thinking behind the construction of the first as well as 
the final draft. We feel that the content validity in this con- 
text is more important than the statistical validity. We shall 
be grateful to receive comments on the report as wellas оп the 

e utility of the test. 


We take this opportunity to thank all the principals, head- 
masters, and teachers who gave us facilities for the field work 
connected with the preparation of this test. i 


Principal 
Delhi 
5th January, 1962, 


A REPORT ON THE CONSTRUCTION AND 
STANDARDISATION OF AN ACHIEVEMENT TEST IN 
HINDI FOR CLASS VIII 


Standardised achievement tests are as important in selection 
and guidance of students as the intelligence tests. Infact these 
may be considered somewhat more important as they may 
predict future success in school more accurately than the 
intelligence tests. Intelligence is one of the very important 
variables which contributes towards. high achievement in 
scholastic pursuits. It tends to neglect innumerable persona- 
lity traits, habits and attitudes which go in to determine a 
person’s achievement. An achievement test may be better 
predictor, in the sense, that it indirectly takes care of such 
variables in the level attained so far. 


Hindi with its growing importance was first to get our 
attention, Keeping in mind the diversification after the VIII 
grade, it was decided to standardise an achievement test in 


_ Hindi for Class VIII. 


Construction of an achievement test need two preliminary 
steps, namely, determining (a) the objectives of teaching a 
particular subject and (b) the appropriate level of difficulty of 
language as well as the complexity of the material which the 
students are expected to deal with understanding. In determin- 
ing the objectives of learning Hindi in class VIII in Delhi, 
assistance was sought from books on teaching of mother- 
tongue and. some experienced teachers. The three major 
objectives seemed to be: 


1. The ability to read with comprehension. 
2, The ability to express one’s ideas in writing correctly. 
3. The ability to express oneself in speech. 


Obviously the third objective is outside the scope of a paper 
pencil test. Therefore it was decided to concentrate only on 
the first two objectives. 


^ 
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Now the task before the author was to include the major 
aspects of these two objectives in situations which could be 
responded to on paper. For testing reading-comprehension, 
the best possible situation would be to present a number of 
extracts (which have presumably not been read by the children 
earlier) of varied nature and complexity and ask searching 
questions based on these. The questions should go beyond the 
verbal meaning of the passage to the underlying ideas, total : 
affect or the central themes. Butit has been the experience 
of this writer that the young children. get easily disheartened 
on seeing a number of passages coming one after the other. 
They then try to get over the situation by marking the answers 
randomly (the questions have to be objective type for ease of 
scoring), thus, reducing their attempts most invalid. Therefore 
only a few passages were included for reading, Essential to 
comprehension of the reading material are knowledge of the 
meanings of the words and the most commonly used proverbs 
etc, It ів true that a passage can be understood to a large 
extent even if a word or so are missed but this cannot be said 
when a number of words or phrases are missed in a passage. 
Therefore, the meaning of words and phrases were also included 
as subtests to test reading comprehension, 


Written expression could also be tested best by asking 
children to write something on some of the given titles. But 
as all concerned are familiar with the ‘difficulty of assessment 
of such responses, this was abandoned altogether (this, how- 
ever, may not be taken as a hint to belittle the value of well 
organized spontaneous piece of writing as a medium of evalua- 
tion of the ability to write. Its absence from the test should 
rather be considered as a limitation of the test. Tho test users 
find it useful to supplement it by getting a composition written 
by the children). The other aspects of good expression are— 
good sentence structures, the use of the most appropriate word, 
correct spellings and correct grammar. The first three are 
included in the test while the last one is not. The reason being 
that formal grammar is taught and tested directly in the 
schools and the children do learn it but whether it actually 


enters their writing is a question which needs to be answered 
experimentaly. _ 
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The whole plan now got reduced to six sub-tests enumerated 
below : 

1. Reading Comprehension 

2. Word-Meanings 

3. Meanings of Proverbs 

4. ' Sentence-Structures 

5. Diction (The use of the most appropriate "word) 

'6. Spellings. 


In determining the level of difficulty, textbooks formed the 
biggest source, other readings which the teachers thought were 
suitable for this grade а secondary source. 


Construction of the Test 

A number of passages of moderate length were collected 
from books and magazines. Textbooks were strictly kept out. 
On each passage a number of multiple choice questions ‚were 
framed. 


Forsub-tests on word meanings and proverbs, fairly long 
lists of words and proverbs were collected from textbooks and 
‚other reading materials of suitable difficulty. Some children 
were asked to write the meanings of these proverbs and words 
The responses helped us in two ways (a) in providing alternative 
responses (b) in eliminating very easy and very difficult 
questions. For proverbs, the statements made by the students 
were often reconstructed to give them a better form. Very 
often the nearly correct response had to be rephrased to make 
it convey the meaning as accurately as possible. After the 
multiple choice items were constructed, these were administered 
to some adults (Hindi knowing) individually to make am that 
the correct answer was distinctly identifiable." Minor differ- 
ences were resolved by appeal to authority. But in case the 
agreement could not be reached upon, such items were dropped 


1 Iv is interesting to note that adults with adequate know- 


ledge of Hindi differed sometimes about the exact meaning 
of some of the proverbs. 
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out as these may not be able to measure students’ knowledge 
reliably. In case of the word-meanings while the alternatives 
were very often selected out of the responses made by the 
students on open questions, the correct answers were checked 
with the dictionary. 


Children’s exercise books were scanned for poor sentence- 
structures and words most commonly mis-spelt. For poor 
sentence-structures, some cheap magazines etc., were also used. 
For sentences, the children were asked to identify the best 
structure out of the three given. For spellings, the list con- 
sisted of both correctly as well as incorrectly spelt words, The 
children had to perform two functions here, first in recognizing 
whether a given spelling was correct or incorrect and secondly 
in rewriting the correct spellings of the word misspelt, 


For diction, a number of sentences were selected and some 
important words were ommitted. The children were to pick 
out the best suitable out of a given list for the blank space, 


All these sub-tests were again, tried on small samples of 
children mainly to make necessary changes in the instructions. 
The sub-tests, as they stood for try-out for item analysis had - 
the following number of items. 


Name of the Test No. of Type of 
Items Question 
sub-test 1 Reading Comprehension 20 Multiple Choice 
» » 2 Word Meanings 70 " 
» » 9 Meaning of Proverbs 24 » к 
» »  Sentence-Structures 15 a и 
» » 5 Diction AME TI 
» » 6 Spellings 50 е » 
212 


Item Analysis 


The sub-tests were kept separate for trying out so that no 
particular test suffers from too many ommissions (specially if 
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it came towards the end) the tests were administered to 160 
boys and 174 girls of VIII grades towards the end of the 
school year. The item analysis was carried out separately for 


boys and girls. 


For each sub-test the scripts were, arranged in descending 
order of the scores and twenty seven per cent soripts from 
either extreme were taken out for item analysis, the reason 
why this selection was not'done on the total scores was that 
the tests were of unequal length and the longer ones would 
have dominated the selection. For each item the number of 
responses to each alternative was recorded for both high and 
the low group. The proportion of those who pass was calcu- 


lated by the formula se Y The difficulty value was 


the average of the two and the discriminating index as the 
difference between the two. The procedure is illustrated by 
the following example : 


ITEM ANALYSIS 


Test Hindi Achievement Part 6 
Item mfi I. Val ET 2. TTT gal 3. fear gat 4. ЧЕТ gar 
Tem 
Group | Omit 3| 4 6 | NR | Total 
ABE Б ers 
ES (|| «| 2] -|-|- 47 
2 47% 
Proportion of H who кг, ==1.00 
а — 10/3 32, 
Proportion of L who know= = ise == 0 


Difficulty index=.85 
Discriminating index=,30 
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Оп a separate sheet all the items of a particular subtest were 
written down with their difficulty and discriminating indices 
both for boys and girls. Studying the sheets having complete 
record of the distribution of conveyed correct answers among } 
given responses, appropriate remarks were added against each 
item. Each item was studied twice, once every time in light of 
the data available from boys and girls. The following illustra- 
tion will make the point clear 


Sub-Test No. 1 
Girls 


Boys 


Diff. Dis. | Diff. Dis. 
Index Index| Index Index 


Item No. 


13 Л9 43 .69  .57 Easy but Satisfactory. 
Good. (selected) 

Satisfactory, Alt. 2 does 
not function very much. 
Difficult, alt. 1 distracts 
H. (rejected) 

Good. Very good. (selected) 


15 Sl) .59 16  .32 


16 60.63 55.84 
21 .53  .12 48 .65 


Very poor. Good. (rejected) 


The following criteria were used for the selection of the 
items. 

(a) The item should have a difficulty index between .2 and 
.8 for both boys and girls. 

(b) The discriminating indices should not be less than ‚3 
except in the rare cases of extreme difficulty indices. 

(c) Ifa given alternative response had larger frequency than 
the keyed correct response, such-an item was rejected, 


(d) If an alternative distracted larger number of H than L, 
such an item was rejected, 


1. Entries were made in different inks so that the person 
studying the item can associate the remarks to the 
appropriate groups. 


=—ee 
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Occasionally, when an item seemed satisfactory but a given 
alternative proved ineffective, it was replaced in the final form. 
The number of such items is very small. A few items which 
functioned very well for one group (boys or girls) but somewhat 
poorly for the other group were also included in the final form, 
but the number of such items, again, is rather small. 


The following table gives the distribution of difficulty and 
discrimination indices of 100 items selected finally for boys and 
girls. 


Diff, Indices Dis. Indices 
Girls ` Boys Girls Boys 
<.30 7 23 5 11 
80 — .39 14 | 14 13 11 
40 — .49 20 “95 93 | 90 
.50 — .59 25 ED 18 21 
.60 — .69 15 19 15 24 
> .70 19 11 26 13 
EL eS ae A с... 
100 100 100 100 


The median points for difficulty indices are 53.1 and 44.7 
and for discriminating indices 54.5 and 53.3 for girls and bu 
respectively. 


The Final Form : 
The final form has the following composition now, 


No. of items 
1. Proverbs 14 
2. Reading Comprehension 17 
3. Word-meanings - 95 
, 4. Diction 90 
5. Sentence Structures 8 
6. 


Spellings i 16 
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The spellings subtest emerged in a somewhat changed 
form. In the first draft, the items were mixed words spelt 
correctly or otherwise. But it seems that the students could 
recognise the correct spellings easily, therefore a majority of 
these words got eliminated. The subtest in final form consists 
only of incorrectly spelt words and the children are asked to 
write their correct spellings in the spaces provided. 


A number of questions needed answering before the test 
could be administered for finding the norms. The first and the 
foremost being the fixation of time limit for the test. The test 
is a power test and not a speed test, therefore, theoretically, no 
time limits may be fixed. Each child may be allowed to take 
his own time. But it has been the experience of this writer 
that some children continue to sit with their scripts even when 
they have ‘finished work. This is unnecessary. A generous 
time limit is a much better proposition, The test was adminis- 
tered to eighth grade students in three schools and the children 
were asked to encircle the item, they were working on after 30, 
45 and 55 minutes, The quickest child could attempt all the 
items in 25 minutes. The majority took more than 45 minutes 
to finish the test. A small group continued to work even after 
55 minutes. It was decided therefore to fix the time limit as 
60 minutes. 


This thing settled, an attempt was made to study the 
validity and the reliability of the test. 


Validity : 

The validity of an achievement test can in part be under- 
stood by studying the procedures and criteria used in its cons- 
truction. An attempt has been made in the beginning to 
acquaint the reader with this in the early parts of this report, 
The statement here will deal merely with the experimental 
demonstration of the validity of the test. Two criteria were 
used for this purpose, namely, (a) The rise in the average score 
from class VII to class IX on this test (b) the extent of its 
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correlation with the scores made in Hindi in the examinations 
set by the teachers. 


For evidence on ‘the first point, the test was administered 
to all the children of VII, VIII and IX grades of а certain 
Government Higher Secondary School for Boys. Their mean 
scores are as follows : 


Grade Mean Score ON 
VII 27.30 123 
VIII 36.65 128 
IX 50.27 82 


The rise in the mean scores is fairly sharp to inspire confi- 
dence in the utility of the test. 


In another school this test was administered twice (at an 
interval of one week) to check the test-retest ‘reliability. The - 
scores on the first administration were correlated with the ` 
achievement of the children on the term examination? in Hindi— 
taken within three weeks of the first administration of this 
test. The co-efficient of correlation between two sets of scores 
is 69. (MT=62.7, SD=14.25, M termexam.=55.6 SD—13.87 ; 
N=90) 


Reliability 

The test-retest reliability co-efficient worked on scores from 
two administrations of the test on the same group after an 
interval on the one week worked out to be .89 (M,— 62.2 
SD,= 14.24 M,=66.9 SD,= 13.83; N=88). 


Erom the sample of norms, small random samples of boys 
and girls were drawn and split half reliabilities were calculated. 


1. The reliability of this criterian may be questioned, But 
it is one of the two indications towards the same direc- 


_ tion. The relationship may be interpreted with this 
reservation in mind. 


IO 


Corrected by the spearman-Brown Formula these figures are as 
follows : 


r Mean No. 
.93 57.07 84 Girls 
„95 36.15 106 Воув 


These data are only indicative, As the test is used in 


schools, more information will be available about its reliability 
and validity. 


NORMS 


The Sample 


A welllrepresentative sample is basic to the development of 
norms. Sufficient thought was given in the selection of the 
sample for this test. A strictly random sample was discarded 
in favour of somewhat structured sample. Zonal distribution 
of Delhi was obtained from the post office with the names of 
all the areas covered by a particular zone number. A list of 
higher secondary schools! was obtained from the Directorate of 
Education, Delhi. All the schools (separately for boys or girls) 
in a particular zone were arranged, in alphabetical order, 
Every fourth among the girls’ schools and every sixth among 
boys’ schools was included in the sample? 


In this way, representation from all parts of Delhi was 
assured, A total of 3470 children including 1932 boys and 
1538 girls were tested. 


1. Jt was decided to exclude middle and high schools as 
they were very few in number, 
will soon be non-existent as all 
converted into higher Secondary scho 


The latter category 


schools are being 
ols, 


2, The list of schools is given in the Appendix, 


II 


The following are the distributions of scores of the 
samples for norms. 


Boys : С 
Scores Proportion of 
Frequency 
0-9 1.40 
10-19 8.11 
20-29 20.39 P^os- - 
5 
30-39 26.02 E, 
40-49 20.96 $20 
ч 
50-59 EN x 
60-69 7.54 $ 
o 
б 2. 
70-79 208 бш. 
80-90 4p om 
90-99 —. 5- 
100.00 
о 10 20 30 40 50 60 70 80 90 
Scores 
Girls 
Scores Proportion of 
Frequency 
0-9 .46 
10-19 2:02 o 
25 
20-29 11.55 , 
o 
30-39 21.33 E 20- 
40.49 23.29 3 
60-59 1801 %15- 
60.00 11.22 8 
70-79 6.92 Б 
80-89 OE EE 
90-99 52 
100.00 i 
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APPENDIX 


LIST OF SCHOOLS INCLUDED IN THE SAMPLE 
FOR NORMS 


Boys 


Arya Craft Higher Secondary School, Delhi Cantt, 
Delhi-10. 
D. A. V. Higher Secondary School, Baird Road, New 
Delhi-1. ў 1 
D. A. У. Higher Secondary School, Yusuf Sarai, New 
Delhi 3. 
D. A. V. Higher Secondary School, Rajinder Nagar, New 
Delhi-5. 9 
Gandhi Memorial (Government) Hig 
Shahadra, Delhi-7. 
Government Higher Secondary School, Defence Colony, 
New,Delhi. 
Government Higher Secondary School, Main Vinay Nagar, 
(IInd shift) New Delhi-3. 
Government Higher Secondary School, Rani Jhansi Road, 
New Delhi. 
Government Higher Secondary School, (No. 2) Mehrauli, 
New Delhi-3. 
Government Higher Secondary School, Tibbia College, 
New Delhi. 
Government Higher Secondary School, Rajouri Gardens, 
New Delhi-5. ч 
Government Higher Secondary School, West Patel Nagar 
New Delhi. А 
Government Higher Secondary School, Mori 

i G 
shift) Delhi. i 20 ste Visti 


her Secondary School, 


14. 


15. 
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‘Government Higher Secondary School, Qutab Road, (2nd 


shift) Delhi. 


Government Model Higher Secondary School, Ludlo 
Castle Road, Delhi. 


Government Model Higher Secondary School, Timarpur, 
Delhi-8. 


Jain Higher Secondary School, Darya Ganj, Delhi. 
Mahavir Jain Higher Secondary School, Nai Sarak, Delhi. 


N.D M.C. Higher Secondary School, Rouse Avenue, New 
Delhi. 


Sant Nirankari Higher Secondary School, Lakkar Mandi, 
Pahar Ganj, New Delhi-1. 


`5. D. Higher Secondary School, Kundewala, Ajmeri Gate, 


Delhi-6. 
Sardar Patel Higher Secondary School, Lodi Road, New 
Delhi. 

Girls 


Bharatiya Mahila (Government) Craft School, Shahadara, 
Delhi-7. 


Government Higher Secondary Sehool, Aram Bagh Lane, 
New Delhi. 


Government Higher Secondary School, Ram Nagar, Ш 
shift) New Delhi. 


Government Higher Secondary School, Main Vinay Nagar, 
(Ist shift) New Delhi, 


Government Higher Secondary School, Lodi Road, (Ist 
«shift) New Delhi. 


Government Higher Secondary School, No. iTi 


lak Nagar, 
New Delhi. 


Government Higher Secondary School, Billimaran, Delhi-6, 


Government Higher Secondary School, 


Ja .. 
(dst shift) Delhi-6. ma Masjid, 
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Government Higher Secondary School, Kothi Anar, 
Subzi Mandi, Delhi-6. ‘ 

Government Higher Secondary School, Kishan Nagar, 
Delhi-7. 

Government Girls Higher Secondary School, Darya Ganj, 
Delhi-7. 

Government Girls Higher Secondary School, Roop Nagar, 
Delhi 8. 

Government Girls Higher Secondary School, Model Town, 
Delhi-9. 

Laxmi Girls Higher Secondary School, Khari Baoli, 
Delhi-6 

Nav-Hind Higher Secondary School, Rohtak Road, New 
Delhi 5. 

RELM. Higher Secondary School, Karol Bagh, New 
Delhi-5. 

Sc. Thomas Higher Secondary School, Reading Road, New 
Delhi-1. 

Vidya Bhawan Girls Higher Secondary School, Lodi Road, 
New Delhi. 


^ 


